Statistics of Regenerative 
Digital Transmission 

By W. R. BENNETT 

(Manuscript received April 16, 1958) 

Statistics of a synchronous binary message pulse train applied to a re- 
generative repeater are related to those of the original binary message, which 
is assumed ergodic. It is shown that the ensemble of possible message pulse 
trains is a nonstationary random process having a periodically varying 
mean and autocovariance. A spectral density is calculated which shows line 
spectral components at harmonics of the pulse rate and a continuous density 
function, both with intensity proportional to the square of the absolute value 
of the Fourier transform of the standard pulse at the frequency considered. 
The continuous component has many properties similar to thermal noise 
but differs in that, under certain conditions described, it can exhibit regu- 
larly spaced axis crossings, can be exactly predicted over finite intervals and 
is capable of producing discrete components when nonlinear operations are 
performed on it, even though no line spectral terms are originally present. 
The analytical restdts are applied to the problem of deriving a timing 
wave from the message pulse train by shock-exciting a tuned circuit with 
impulses occurring at the axis crossings. 

I. INTRODUCTION 

An ideal regenerative digital repeater is defined here as a nonlinear 
time-varying device with response expressed as the product of a stair- 
case output vs. input function such as shown in Fig. 1(a) and a time- 
sampling function such as shown in Fig. 1(b). The first function (a) 
converts a continuous range of possible input values to a discrete or quan- 
tized set of output values. The second function (b) is a time-varying 
response function which ideally makes the repeater sensitive only during 
infinitesimally narrow time intervals with regular spacing T = \/f r . 
Taken together, the two functions quantize and sample the input wave 
at uniformly spaced instants of time. The input wave consists of a dis- 
crete-valued message component plus noise and distortion accumulated 
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in transmission from the previous repeater. If the noise and distortion 
are sufficiently small to confine the departure from the proper discrete 
message value within one quantization interval at the sampling instants, 
the regenerated wave matches the message and errorless transmission 
is achieved for any number of repeater spans. 

To economize bandwidth, the actual pulses transmitted are not in- 
finitesimally sharp, nor even rectangular as indicated in Fig. 1(b), but 
are multiples of a standard finite width pulse g(t) which may be consid- 
ered to be generated by a linear network from the sharp samples. A typi- 
cal outgoing wave from the repeater is therefore expressible by : 



x(t) = £ a n g(t - nT), 



(1) 



where the sequence a„ , n going from — oo to <x> , represents the message 
values. In much of our work we shall specialize our attention to the binary 
case, in which there are only two possible values of a„ , which we shall 
usually take as zero and unity. The corresponding output vs. input func- 
tion of Fig. 1(a) then takes the form shown in Fig. 2. A typical outgoing 
wave train is shown in Fig. 3 for the message sequence 

••• 1 00 10 1 1 ••• . 

The ideal repeater requires an absolute clock to supply the timing 
control exemplified by Fig. 1(b). In practical transmission systems of 
considerable length, it may not be feasible to supply such absolute timing 
information. An alternate procedure, for example, derives the timing 
wave from the signal pulse train itself by applying a portion of the wave 
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Fig. 1 — Specification of ideal regenerative repeater characteristic. 
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train to a circuit tuned to the pulse repetition frequency. If the circuit 
has a sufficiently high Q it continues to oscillate at the desired frequency 
during the gaps when no message pulses are present. Design of the tuned 
circuit requires a statistical analysis of the pulse train. This is one of 
many important statistical problems associated with practical, as dis- 
tinguished from ideal, regenerative repeaters. 

In this paper, we consider the following specific problems: 

1. Properties of a digital message pulse train as a random noise source. 

2. Derivation of the pulse repetition frequency from a pulse train by 
shock excitation of a tuned circuit. Under this topic, the following ef- 
fects are studied: 

(a) message statistics 

(b) message pulse shape 

(c) Q 

(d) mistiming 

(e) noise. 

3. Effect of time jitter in received pulse train on recovered analog sig- 
nal. 

The important problem of analyzing accumulated effects in a chain of 
non ideal regenerative repeaters is discussed in a companion paper by 
H. E. Rowe. 1 Both this paper and that of Rowe are intended to pro- 
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Fig. 2 — Binary out put- vs. -input response. 
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Fig. 3 — Typical binary wave train. 
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vide analytical background for the two preceding papers in this issue. 2 ' 3 
Reference is also made to a paper by E. D. Sunde which treats many 
of the same problems in a somewhat different way and gives results for 
specific repeater embodiments. 

II. A DIGITAL MESSAGE AS A RANDOM NOISE SOURCE 

The digital message may be regarded as a random time series of dis- 
crete numbers. In the notation of stochastic processes, consider the en- 
semble of possible messages M(t), where a typical M(f) consists of the 
infinite discrete time sequence : • • • a_ 2 , a_i , ao , a t , a 2 • • • . The values 
of the a's belong to a specified set of discrete numbers and each possible 
sequence has a probability of occurrence associated with it. We assume 
that the message ensemble is ergodic; that is, averages over the ensemble 
at fixed time are identical with averages over time in any member of the 
ensemble, except for a set of probability zero. It follows that the en- 
semble is also stationary; that is, averages over the ensemble do not de- 
pend on position in the sequence. For our purposes wc do not go beyond 
second-order statistics and shall base our calculations on two ensemble 
averages, the ordinary mean and the autocovariance. 

The mean mi is defined by the ensemble average for any n : 

mi = av o„ . (2) 

The value of mi is a constant for the message ensemble. For example, 
in the binary case in which zero and one occur with equal probability 
mi is equal to one half. The autocovariance R(n) is defined by the en- 
semble average 

R(n) = av (akdk+n) for fixed k. (3) 

The value of R{n) depends on n but not on k. It is determined by the 
dependency of successive message values. If the message consists of in- 
dependent numbers, the value of R(0) is the average squared message 
value and R (n) is equal to the square of the mean for n not equal to zero, 
since the average of the product of independent quantities is equal to the 
product of their averages. From the ergodic property, these quantities 
may also be derived from almost all members of the ensemble indi- 
vidually, thus: 

1 N 

m = lim OUT ■ T 2 «« , (4) 

1 N 

R(n) = lim . , 2 a k a k+n . (5) 

JV-oo ZI\ -t 1 A=-A' 
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The actual wave sent over the line from one repeater to the next is the 
function x(l) given by (1). We may regard x(t) as a typical member of 
the pulse ensemble \x(t)}. Unlike the message ensemble {M(t)\, the 
pulse ensemble [x(t) } consists of continuous functions of time rather than 
discrete time series. We shall now relate the statistics of the pulse en- 
semble to those of the discrete message ensemble. 

We first evaluate the ensemble average of [x(t)} by holding t fixed 
and averaging over all members. Then, since the average of a sum is 
equal to the sum of individual averages, and since the standard pulse 
g(t) is the same for all members of the ensemble, we find 

av {x(t)\ = av 2 a "9(t - nT) 

«=— 00 

= E av (a n )g(t - nT) (6) 

n=— oo 

= nh 2 g(i ~ nT). 

It thus appears that the ensemble average varies with time. This is not 
really unexpected since it seems reasonable that we should find values in 
the middle of a pulse interval to be distributed quite differently from 
those at the beginning or end. In fact, we should expect the ensemble 
average to vary periodically at the pulsing rate, and we readily demon- 
strate this by noting that 

av [x(t + T)\ = mi £ g(t + T - nT) 

(7) 

= m T,j\t - (n - 1)T] = avx(t) 

by substitution of the summation index n' = n — 1. 

The periodicity of the ensemble average suggests a formal Fourier 
series expansion, thus 

00 

av x(t) = 2 c m exp (2mTJf T t), (8) 

m— oo 

c m = f r / av x(l) exp (-2?nirjf r t) dt 

oo .r ^ 

= m l f r £ / g(t - nT) exp (-2mirjf r t) (it. 

n=-oo JO 

We now substitute / — nT = it in the integral. The limits then become 
— nT to — (n — \)T while the exponential becomes exp ( — 2m Trjf r ii), 
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since f r T = 1. The summation of finite integrals with adjoining limits 
may then be replaced by a single infinite integral, giving 

c m = mifr I g(u) exp (-2mwjf r u) du. (10) 

J— 00 

If we introduce the Fourier transform of the standard unit pulse by 

G(f) = f g(t) exp (-2xjfl) dt (11) 

•'—00 

we observe that 

c m = mJMmfr), (12) 

and, hence, 

00 

av \x(t)} = mif r E G(mfr) exp (2m.TJf r t). (13) 

m=— oo 

The ensemble average is thus expressed as a Fourier series in time with 
the amplitude of the mth harmonic of the signaling frequency propor- 
tional to the amplitude of the spectral representation of the unit pulse 
at that same harmonic; frequency. We note that an ensemble consisting 
of precisely this set of harmonics and no other terms would exhibit just 
this same result for its ensemble average. It is convenient, therefore, to 
resolve our pulse ensemble into a set of such discrete nonrandom har- 
monic components plus a remainder which has random properties and 
zero mean. We consider therefore the ensemble 

{//(/)} = {*(*)} - av {lit)} = jt m (a n - m)g(t - nT). (14) 

Then, 

av{y(01 = 0. (15) 

We explore farther by evaluating the autocovariance function R u (t, t) 
for the ensemble \y(t)}. By definition, 

R v (t, t) 

= av {y(t)y(l -\- t)) 

{ 00 00 "\ 

Z (am - m)g(t - m.T) 2 (a» - mi)g(t - nT + r) 
m oo n=-oo J ^Qj 

00 00 

= Z E av[(a m - ffl,)(a„ - mi)]g(t - mT)g(t - nT + r) 

m=— oo n=— oo 

= E £ [R(m - n) - mflgit - mT)g{t - nT + r). 

m=— eo n=— oo 
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By replacing t by t + T and increasing both summation indices by unity, 
we see that R u (t, t) is periodic in / with period T. Hence, as in the case 
of the mean, 

X 

Ry(r,0 = E <i k expWwjf r t), (17) 

A=-oc 
dk = fr [ Ry(T, t) eX P (-2kTJf r t) dt 

= /,! Zlfi(m - n) - mi 2 ] (18) 

( g(t - mT)g(t - nT + r) exp {-2kirjf T t) dt. 
Jo 

We substitute m — n = m', I — nT = t', and find after some rearrange- 
ment analogous to that used in obtaining (10): 

d k = f r E [R(m) ~ m]F(T + niT, /,;/;), (I!)) 

where 

F(r,f) = [ g(t)g(t + t) exp (-j2tt/0 dt. (20) 

J— 00 

By the convolution theorem, 

F(t, f) = f G(\)G*(\ + /) exp [-/27rr(X + /)] r/X. (21) 

J— a© 

In the special case of independent message values, 

/?(0) = av (a,r) = wo ; R(n) = av 2 (a„) - mf, n ^ (22) 
and 

r/, =/ r var(o„) F(t, kf r ), (23) 

where var (a„) is the variance of the o's defined by 

var (a„) = wj 2 — m* = av (a„ ) — av"' a„ . (24) 

There is no reason, in general, for F(t, kf r ) to vanish for all nonzero 
values of k, and hence the autocovariance of the ."/-ensemble does not 
reduce to an expression independent of time. It appears, therefore, that 
separating out the periodic components which account for the fluctuat- 
ing mean does not make the remainder a stationary process. We there- 
fore cannot invoke the Fourier transform relationship between auto- 
covariance and power spectrum to find a power spectrum for our pulse 
ensemble, even after the periodic components have been removed. 
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A procedure which has often been used in similar situations is to make 
the process stationary by assuming a random phase relationship between 
the members of the ensemble. We do not wish to do this here because 
synchronous phase is an important property to be preserved in digital 
regeneration. However, there is a meaningful definition of a power 
spectrum which can be used without reference to the fluctuating auto- 
covariance. We shall calculate the spectral density in this way, but, as 
might be expected, the resulting function is the same as would be ob- 
tained by randomizing the phases of the ensemble. 

Consider first the ensemble y N (t) which includes only the pulses from 
n = — N ton = N: 

y N (t) = E (a„ - mi)g(t - nT). (25) 

n=—N 

Then, for unit pulses which possess a Fourier transform, the Fourier 
transform S N (f) of y N {t) exists and is given by 

S K (f) = Z (a. - mMf) exp (-2nrjfT). (26) 

n— N 

By Parse val's theorem, 

f y N \t) dt= f \ S N (f) I 2 df. (27) 

J— co v— co 

Let the average of the ensemble ys(t) over the interval —NT to NT be 
represented by av N y N \t). Then, 

= (2ATTT)r£ av|&(/)N/ (28) 



Also, 



avoo yJ(t) = lim av* y N 2 (t) 



y f" av 1 S N (f) I 8 M 

= is L m + dt df 

= [ w(f)df, 



(29) 



where 



. , .. av | S N (f) | 2 / Qn <. 

m(/) = ia m + i>r • (30) 
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From (29), w(f) as defined by (30) satisfies the requirement for a spec- 
tral density. From (20), 

av | S N (f) | 2 

= av [S N (f)S N *(f)} 

= E E av[(a„-m 1 )(a„ l - »i,)]G(/)G*(/) exp[2xj[fr(m - n)] ( 31 ) 

m— W n=-AT 

= E E [«(« - ») - Wl | G(/) | 2 exp [2*#T(m - n)]. 

7ii=-AT n=—N 

Let to — n = /,-, giving 



av | S N (f) | 2 = E E [«(*) - mi 2 ] | G(/) | 2 exp (frrjkfT). (32) 



n+.V 

£ 

«i=-AT k=m-N 

The order of summation can be interchanged by the formula: 

N m+N k+N IN N 

EZ=ZZ+ZZ. 03) 

m=— W k=m—N k=—2N m=— AT A— 1 m=>k—N 

Since the summand does not depend on m, we perform the summation 
on to by counting the terms. The result is: 



av | S N (f) | z - (2iV + 1) | &'(/) I" 1 22(0) - m{ 

»/ ,. X ! (34) 

+ 2 E ( i - gjv + J [*(*) - ™i 2 ] cos 2»*yr] • 

From (30), then, 

«>(/) = /, I (?(/) I 2 (b(0) - TOi 2 + 2 E [«(*) - mft cos 27rfc/r) . (35) 



/— i 



In the special case of independent message values, R(0) = w 2 = mi and 
R(fc) = mi 2 for k ?* 0, giving a result in agreement with the well-known 
solution based on a random phase ensemble average, namely 

io(f) =/ r m 1 (l - m 1 )\G(f)\\ (36) 

This spectral density function is defined for both positive and negative 
frequencies. If the densities at negative frequencies are added to those of 
the corresponding positive frequencies, the above result is multiplied by 
two. 

The spectrum of j y(t) \ is thus continuous and is proportional to the 
squared absolute value of the Fourier transform of the unit pulse. The 
spectrum of the actual pulse ensemble has added to the above con- 
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timious spectrum a set of line spectral components given by (13). The 
line spectral terms occur at harmonics of the signaling frequency and 
have amplitudes proportional to the unit pulse spectrum evaluated at 
the harmonic frequencies. If the pulse spectrum vanishes at any harmonic 
that harmonic does not appear in the \.v(t)\ ensemble spectrum. Equa- 
tion (13) can also be written in the form 

av [x[t)} = w,/ r G(0) 

(37) 
+ 2mif r £ ! G(mfr) | cos [muj + ph G(mf r )]. 

From this expression it is clear that the dc component has mean square 
mi Jr G'\0) , while the mean square value of the /nth harmonic is 

2mx 2 /r 2 [G(m/ r )| 2 . 

Fig. 4 gives curves of the continuous and line spectral density com- 
ponents for independent binary on-off signaling with various standard 
pulse shapes. For this case, if pi is the probability of the value unity, it 
follows that 

m-i = pi ; m-> - m, 2 = pi(l - pi). (38) 

The continuous part of the pulse train spectrum has much in com- 
mon with thermal noise. An audible band selected between adjacent 
harmonics sounds to the ear like thermal noise. If the signaling rate is 
placed well above the noise band a random on-off pulse train serves 
adequately as a hiss source in a vocoder synthesizer. Oscillograms and 
spectrograms of narrow-band telegraph noise not including a harmonic 
would appear to the eye to be indistinguishable from thermal noise. The 
curves of Fig. 4 provide useful quantitative data relating the amount of 
noise produced in this way for specific cases. 

It must not be concluded, however, that random telegraph noise is hi 
all respects equivalent to thermal noise with the same spectral density. 
The telegraph noise remains a nonstationary process and has a phase 
structure among its components which thermal noise does not possess. 
The nonstationary properties of the telegraph wave ensemble are not 
the most general but are of a special kind which have sometimes been 
described as "periodically stationary." We have suggested the name 
"cyclostationary" for this type of process, i.e., one in which the ensemble 
statistics vary periodically with time. Analogously, the name "cyclo- 
ergodic" will be used for cyclostationary processes in which statistics 
over the ensemble for fixed time are the same as statistics over the in- 
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Fig. 4 — Continuous and line spectral density components for independent 
binary on -off signaling with specific pulse shapes. 



stunts of time differing from the fixed instant by multiples of the period 
in almost all individual members of the ensemble. A cycloergodic en- 
semble is cyclostationary but the converse is not necessarily true. 

An important practical difference between telegraph noise and ther- 
mal noise is that the former can be generated determiiiistically if the 
message values are known or can be found. This follows because the wave 
form is completely determined by the sequence of message values and the 
standard unit pulse wave form. Use of telegraph noise for masking other 
waves is therefore subject to the qualification that, if the telegraph mes- 
sage can be read, the noise can be removed. Reading the message becomes 
more and more difficult as the ratio of bandwidth to signaling frequency 
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is made smaller, and the overlapping of adjacent pulses in time becomes 
correspondingly greater. From the standpoint of digital transmission, 
reading the message is, of course, a paramount objective and the band- 
width of the transmission medium must be made large enough and the 
noise and distortion small enough to enable a correct reading to be made. 
A further salient feature of the telegraph noise ensemble as contrasted 
with thermal noise is the possibility of regularly spaced axis crossings or 
zeros of the received wave. From (1) and (14) we see that both x(l) 
and y(t) will have zeros at points spaced T seconds apart if the stand- 
ard pulse g(t) has such zeros. That is, if for some t 

g(t + nT) = 0, n = 0, ±1, ±2, ■ • • , (39) 

then 

x(k + nT) = y(t + nT) = 0, n = 0, ±1, ±2, ■ • • . (40) 

This does not mean that there cannot be other zeros as well, and the 
other zeros in general can have irregular spacings. It is possible, however, 
to exclude irregular zeros in specific cases. For example, if the standard 
pulse is the unit impulse response of a series-tuned circuit consisting of 
resistance R, inductance L, and capacitance C, the function g(t) becomes 
0o(O defined by 

wo Lg (f) = (coo 2 + a) 112 exp (-at) cos (atf + 0); t > 

a = R/2L; tu 2 LC = 1 - R*C/4L; tan d = ft/(2co L). 

By setting cu = 2t/T, we obtain nulls at t and h in the interval 

^ t ^ T, 

where 

Wr = tt/2 - 0, 

(42) 

2-rrh/T = 3tt/2 - 6. 

These represent the only nulls in the interval from zero to T and they 
repeat at t + nT and h + nT for all integer values of n, as shown in 
the full-line waveform of Fig. 5. Furthermore, g (t) changes in sign from 
positive to negative at t = to + nT and from negative to positive at 
t = h + nT. No other sign changes occur. If we consider g (t — mT) 
with m any positive or negative integer, we note that the values between 
to + nT and h + nT are the same as those of g»(t) between t + (n - m)T 
and h + (n — m)T, and hence they are all negative. Likewise, the values 
of g (t - mT) between h + nT and / + (n + l)T are all positive. The 
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Fig. 5 — Response of tuned circuit to synchronous impulses. 

dashed curve of Fig. 5 shows the relation for m = 2. The conclusion is 
that the summations from which x(t) and y{t) are formed consist of 
waves having common nulls and the same sign between nulls. It follows 
that both x(t) and y(l) for the case of g(t) — g (t) have nulls only at 
/„ + nT and h + nT, the axis crossings are from plus to minus at t + nT, 
and the axis crossings are from minus to plus at k + nT. 

We have thus proved that, if g (t) is the standard pulse, the continuous 
noise spectrum arising from a random choice of signaling pulses has no 
effect on the nulls of the composite wave. Telegraph noise therefore is 
profoundly different from thermal noise in that it does not perturb axis 
crossings in a situation in which thermal noise certainly would. Produc- 
tion of an invariant null spacing permits the recovery of the timing or 
clock wave from the pulse train and is accordingly of vital importance 
in the self-timed regenerative repeater. 

In general, the standard pulse will not have the invariant null property 
exhibited by the special function go(t). It may, however, be possible to 
convert the actual g(l) into a new pulse which does have the required 
property. We note that the Fourier transform of go(t) is given by 



<?„(/) = 



j2irfC 



(43) 



1 + j2wfRC - 4ir 2 f 2 LC ' 

An ensemble with standard pulse g(t) and transform (?(/) can be con- 
verted into one with standard pulse g (( — T ) by inserting a linear net- 
work with transmittance function 

Y(f) =~^exp(-j2rfT ), (44) 

provided that Y(f) is physically realizable. Since G (f) is the response of 
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a tuned circuit to a constant spectrum, the problem reduces to the re- 
alizability of the reciprocal of G(f) with an arbitrary delay factor. 

Suppose, however, that the received pulse shape is such that Y(f) 
can not be realized. For example, (3) for the discrete or line spectrum 
components shows that, if the pulse transform (?(/) vanishes at the pulse 
repetition frequency /, and all its harmonics, there are no discrete fre- 
quency components representing the signaling frequency in the pulse 
train. In (44) we would then have G(f) = at / = f r and, since F (f r ) 
is not zero, the value of Y(f r ) would have to be infinite. It might seem 
that in this case the timing information is lost. However, we shall show 
that this difficulty only exists for linear time-invariant methods of deriv- 
ing the timing information. 

To see how we can materialize a discrete component from a con- 
tinuous spectrum, consider a specific case of an uncurbed rectangular 
signaling pulse 

g (t) - 1; < t <T. (45) 

Then, from (11), 



G(f) = (x/) _1 exp (-jirf/fr) sin (tt///,). 



(46) 



It is clear that G(nf r ) vanishes for all integer values of n. If a pulse by 
itself contains zero amplitude at all harmonics of f r , no succession of 
pulses can have nonzero amplitude at these frequencies. However, we 
note that, in a binary on-off system using these uncurbed pulses, a wave 
such as that shown in Fig. G is obtained, in which every message digram 
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Fig. 6 — Train of uncurbed rectangular pulses. 
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Fig. 7 — Recovery of timing wave from transitions of binary pulse train. 
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01 produces an upward transition, every digram 10 produces a down- 
ward transition, and the wave is constant for unbroken sequences of 
l's or 0's. If this wave is applied to the circuit of Fig. 7, which includes 
a differentiator, full-wave rectifier, threshold triggered pulse generator 
and tuned circuit, an output wave containing pulses of form 

g (t - nT + To) 

is obtained where n represents the integer values in the message sequence 
at which 01 or 10 digrams occur. The effective message source is trans- 
formed from the original sequence of zero and unity values to a new 
sequence in which the unity values are associated with 01 or 10 transi- 
tions and the zeros with 1 1 or 00 digrams. A new continuous spectrum 
is thereby obtained and a discrete line spectrum absent from the original 
wave is created. Nonlinear operations have been used to attain this end. 
The system will still operate if either (but not both) the rectifier or the 
nonlinear triggered pulse generator is omitted. If we were dealing with 
thermal noise, even nonlinear operations would not suffice to construct 
a discrete spectrum. 

The impulse response of a tuned circuit is only one example of a stand- 
ard pulse shape which yields correct timing information from a syn- 
chronous telegraph pulse train. Another standard pulse having the same 
essential properties is the response of the same tuned circuit to a rec- 
tangular pulse of duration equal to half the signaling period. When the 
exciting pulse has unit height, the response becomes g^t), defined by 

mL(ji(l) = 

jsin W; < / < T/2 (47) 

3XP [sin W - exp (aT/2) sin w (< - T/2) ; I > T/2. 

When con'/' = 2tt, it may be verified that gi(t) has positive-going axis 
crossings at / = 0, T, 2T, • • • ; negative going axis crossings at / = T/2, 
37V 2, 57' '2, • • ■ ; and no other axis crossings. Hence the summation 
of any such pulses beginning only at multiples of T has the same nulls 
and no others. 

The problem of producing regularly spaced axis crossings from a re- 
ceived pulse train is studied in more detail in the next section, which 
treats the problems associated with derivation of timing information. 
We conclude our discussion here with some further remarks about 
secondary pulse trains triggered from transitions in a primary pulse 
train. Such secondary trains are of major importance in pulse frequency 
derivation techniques. The example given above of a primary uncurbed 
rectangular pulse train is not of much interest in digital transmission, 
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since it would require excessive bandwidth to approximate the square 
waveforms. A more practical type of pulse is the raised cosine of Fig. 8. 
Such a waveform can be transmitted with fair accuracy over a band- 
width slightly less than the signaling frequency. Closest spacing without 
overlapping is obtained when one such pulse is started at the instant a 
preceding one reaches its peak. A flat-topped resultant wave then oc- 
curs between successive individual pulse peaks, as shown in Fig. 8. A 
train of raised cosine pulses can therefore give timing information only 
on the transitions 01 and 10, and the circuit of Fig. 7 is appropriate for 
signaling frequency derivation. It may be verified from Fig. 4 that the 
raised cosine pulse has null values in its Fourier transform at the signal- 
ing frequency and its harmonics. 

The message associated with the transition pulse train is, of course, 
different from the original message and has a different set of statistics. 
It is of interest to calculate the relation between the two for the case of 
binary on-off message source with independent signal values. For such a 



/ \ 7 '< < \ 
.iZ ,/ X,/ \\ 



Fig. 8 — Train of raised cosine pulses. 

source, the values of a,, are selected independently, with the probability 
p t that unity occurs and 1 — p t that zero occurs in any position. Then 
the mean first and second powers are given by 

Wj = m 2 = p. (48) 

and the autocovariance by 

R(0) = w, , R(n) = mi\ n ^ 0. (49) 

The rule for constructing the transition message is given by the fol- 
lowing table: 



Original Message 



1 preceded by 0. 
1 preceded by 1 . 
preceded by 
preceded by 1 . 



Transition Message 



The value 1 occurs in the transition message from two events each hav- 
ing probability wij(l — m,) and hence has probability 2m t (\ — w,). The 
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mean first and second powers of the transition series are therefore given 

by 

r , = r2 = 2m l (l - mi). (50) 

We shall represent the antocovarianee of the transition message en- 
semble by p(n). The value of p(0) is simply the mean square, and hence 

P (0) = 2mi(l - mi) - n . (51) 

To evaluate p(l) we note that the product of adjacent values in the tran- 
sition message is zero except when the original values are 10 preceded by 
0, or 01 preceded by 1. The probability of obtaining the first is 
wii(l — mi)' and of obtaining the second m?{\ — w?i). Hence the proba- 
bility of a 1 1 sequence in the transition messages is given by the sum of 
these two probabilities, and since we obtain unity for the product in this 
case and zero otherwise, 

p(l) = mi(l - m x f + W(l - wi) = »h(l - mi) = n/2. (52) 

For values of n greater than one the constraint imposed by the transi- 
tions effectively disappears, since we may fill in all possible and 1 
values between the critical end points. Thus, in the case of n = 2 we 
obtain values of unity in the transition series two intervals apart for the 
following original message sequences: 

10 1 

10 10 

10 1 

110. 

These have total probability 

p(2) - W(l - mif = rf. (53) 

To evaluate p(3), we merely fill in all possible l's and 0's in a column 
between the second and third above and obtain the same total proba- 
bility because the compound event represented by the first and last 
two columns is independent of that represented by the middle column. 
The probability of the first compound event is rx , as calculated above, 
and that of a second is unity. Hence the complete autocovariance is ex- 
pressed by 

p(0) = r, , 

p(l) = p(-l) =n/2, for |n | > 1. (54) 

P (n) = p(-n) = r, 2 
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Thus, the transition series formed from the independent binary series 
becomes a digram series; that is, one in which adjacent values are de- 
pendent but nonadjaeent values are independent. The discrete compo- 
nents in the spectrum are the same as in the independent case except 
thai m-i is replaced by r y . The continuous spectrum is evaluated by sub- 
stituting p for R and r\ for wij in (35). The result after r\ has been re- 
placed by its value from (50) is 

w{f) = 

2m l {\ - m x ) f r | G(f) |'[1- 2m, + 2n h 2 + (1 - 2?n 1 ) 2 cos 2tt/T]. (55) 

In the special case in which -mi = \, this reduces to the same spectral 
density obtained for the independent message case, (30). 

III. DERIVATION OF TIMING INFORMATION FKOM A RANDOM TELEGRAPH 
MESSAGE 

The existence of standard telegraph pulses which shock-excite a tuned 
circuit to produce a sustained oscillation at the signaling rate for almost 
all message sequences has been demonstrated by example in Section II. 

In practical timing recovery circuits the ideal of a constant-amplitude 
correct-frequeney output is not perfectly realizable. Factors which in- 
fluence the result include the message pulse pattern, the Q of the tuned 
circuit, the presence of noise and the precision to which the natural 
oscillation frequency of the tuned circuit can be made to match the sig- 
naling frequency. 

We shall analyze the problem of timing recovery under the conditions 
in which the ideal performance is almost, but not quite, obtained. The 
errors in this case are relatively small in magnitude and corresponding 
approximations can be made in the calculations which will show with 
sufficient accuracy what the quantitative requirements must be to hold 
the errors within specified small ranges. 

Assume that the tuned circuit oscillates at a frequency very near to 
f r , the signaling frequency, and that Q is sufficiently high to make the 
influence of any one pulse on the amplitude of oscillation slight. Con- 
sider the ensemble of possible responses in the interval from t = to 
/ = 7', with the process having begun at t = — °o . Almost all the wave- 
forms are approximately sinusoidal and the negative-going axis crossings 
cluster about t ' = /,. , where /,. is defined by 

av .-t-(/,.) = 0; nvx'(Q < 0. (56) 

The actual axis crossing for the typical member of the ensemble occurs 
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at /,. + e/2x/ r , where e is ;i small angle representing the phase error and 
has a distribution of values over the ensemble. We assume that the wave- 
form through this axis crossing is that of a sine wave of frequency f r 
:ind amplitude equal to the value of x(t) one-quarter period after the axis 
crossing, i.e.: 

x(t) S -•<•(/,- + e/u r + !T/4) sin [<a r (t - /,) - e], (57) 

with | e | « 1. Then, retaining only first powers of e, we have 

.<•(/,) = ex(t B + r/4). (58) 

We further assume that x(i c + r/4) can be written in the form 

x(t e + r/4) = (1 + f) av x(t c + r/4), (59) 

where | f | « 1. By averaging both sides of this equation over the en- 
semble we deduce that av f = 0. 

It follows from the above assumptions that 

av .r(/,) = av [«( 1 + r > av x(t e + 774)] 

(60) 
= aveav x(t c + r/4). 

Hence, av .?(/,.) = implies av e = 0. The principal quantity of interest 
is the rms phase error, which is the square root of av e . By the assumed 
cycloergodicity of the process, an ensemble average of t is equal to an 
average of the value of e" over all intervals of any member of the ensem- 
ble. From (58) and (59), 

av x\t e ) = [A I + 2f + f) av 2 .>•(/,. + r/4)] 

., .. (Gl) 

= av e-av-.r(/, + r/4). 



Hence, to the first order of small quantities, 

av .r 2 (/ e ) 



av e = 



av 2 ^ c + T/4)- 



(02) 



The mean square phase error is thus expressed in terms calculable from 
the general expressions previously derived for means and covariances of 
the pulse ensemble. 

It is also of interest to evaluate the mean square value of f to validate 
the treatment of f as a small quantity and to estimate the amount of 
amplitude variation. From (59), 

av x% + r/4) = av (1 + 2f + h av 2 x(t e + r/4) 

= (1 + av r) av .»•(/, + T/4). 
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Hence, 

nv jl m av y\t c + r/4) _ fl,(0, U + IT/4) 

S av 2 afc + 774) av 2 z(fc + T/4) ' K ^ 

It is to be noted that the above treatment evaluates only the mean 
square total phase error and does not give a frequency resolution. The 
spectral composition is important, particularly in the case of a chain of 
repeaters and is discussed in the companion paper by Rowe. 

We next calculate the average values appearing in the equations for 
mean square phase error and mean square amplitude ratio variation for 
specific pulse shapes. We assume that the circuit is not tuned to the pulse 
repetition frequency so that a basis for estimating the error from mis- 
tuning can be established. For the case in which g(t) — go(t), the unit 
impulse response of a single tuned circuit, we write (41) in the form 



where 



g (l) = A exp (-at) cos («,,/ + 0); I > 0, (65) 

A = W0 (4Q 2 + l) w /2RQ*\ a = a /2Q; 

(66) 
Q = u L/R, tan 6 = 1/2Q. 

From (6), the ensemble average of x(t) in the interval ^ t f£ T 7 is 

av [*(*)) = '", X) 9o(f — nT) 

(67) 
= mui X) Re exp [(,/' - a)m(l - nT) + jB]. 

n=— oo 

The series is geometric and may be summed to obtain 



. r () mui exp \- m (t - T/2)/2Q] 

V H 2fiQ 2 (eosh 2 mT/4Q - cos 2 m T/2) 



< Slllil —yr COS — — COS 

I 1Q 2 



5H 



«o / - - + e\ (68) 



- cosh ^ sin ^ sin [a, « - T/2) + 6]\ . 

The value of f c in the noise-free mistimed case can be obtained readily 
from (68) by equating the terms inclosed in the braces to zero, giving 

t c = T/2 - d/u + wo" 1 arc tan [tanh (aoT/4Q) cot (co T/2)\. (69) 



STATISTICS OF REGENERATIVE DIGITAL TRANSMISSION 1521 

We note that /,. approaches T/i as Q approaches infinity. If we as- 
sume perfect tuning by setting u (l T = 2ir, (08) becomes 

av .,■(/) = 

nu wMCf + D 1/2 exp [- W ~ t)/2Q] cos Ml - T/2) + 9] < 7 °) 
■iRQ- sinh ir/2Q 

That is, the average waveform of the tuned circuit response becomes a 
damped sine wave of the correct frequency. When Q is large, the damp- 
ing is small. The limiting form as Q approaches infinity is an undamped 
sine wave: 

lim av .r(/) = ^ cos Wr (/ - T/2). (71) 

This result is perfect for frequency recovery. It is to be noted that it docs 
not matter whether the message values are independent or not. In the 
special case in which pulses are generated by transitions only, m y would 
be replaced by n = 2m t (1 - wii), as given by (50). 

To complete the estimate of rms phase error and amplitude ratio varia- 
tion, we must evaluate the average value of x{t) one-quarter period away 
from I,- , and the average squares of x(t) at t = t r and / = /<■+ T/4. The 
value of av x(t c + T/i) is obtained by substituting t = /,. + 7'/4 in (58). 
The evaluation of average squares may be done in general from the 
covariance formula of either (16) or (17)-(21), recalling that 

av x\t) = av" .v(t) + av //(/), (72) 

av// 2 (0 = R u (0,t). (73) 

Two binary cases of considerable importance which simplify considerably 
are those of completely independent message values and the message de- 
rived from transitions between independent values. These are: 

Independent Hinari/ Message 

/ f (0) = mx\ R(n) = roi*; n * 0, 

Rv(r,t) = »ti(l - mi) 2 g(t ~ mT)g(i - »iT + r), ^ 
;1V ,/-(/) = R v (0,t) = m,(l - »/,) E (i\l ~ mT). 
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Transition Message for Independent Binary Values 

R(0) = n = 2mi(l - md, B(l) = B(-l) / x 

(75) 
= ri/2,/2(») - rij |n| > 1, 

B*M = r, E </«• - »iT)(l - n)g(t - mT + r) 

m — w (7(i) 

+ (I - n)r/[/ -(m - \)T + r] + (§ - rOflft -(w + 1)'/' + r], 

av z/ 2 (0 = /?„(0, = n E [(1 - r,V« - mT) 

m— • (77) 

+ (1 -2;- 1 ) J7 (/ - wTOffB -On + Of]. 

For the independent binary message ensemble with </(/) = (jn{t), 
< t < T, 

av z/ 2 (0 = B v (0, = ifn(l - mO E </o 2 « - mT) 

m=— oo 

mi(l - toi) exp [- m (t - T/2)/Q) 
4 sinh w r/2Q(cosh 2 u T/2Q - cos 2 mT) ( 78 > 

• {cosh 2 w T/2Q - cos 2 u T + sinh 2 ( m T/2Q) cos woT 
•cos [wo(2f - T) + 20j - sinh (w T/Q) cosh UT/2Q) 

• sin cooT sin [o> (2J - T) +28]}. 
If cooT 7 = 2ir, this reduces to: 

av7/ 2 W = 

m,(l - m 1 )co r 2 (4Q 2 + 1) exp [-o, r (< - T/2)/Q] cos 2 W + g) (79) 
8R 2 Q A sinh tt/Q 

In the limit as Q approaches infinity, then, 

I, N mi(l — ?tti)av 2 2 , , onN 

av y (t) -* cos av/. (80) 

IV. EVALUATION OK RMS PHASE ERROR WHEN INDEPENDENT ON-OR-OFF 
UNIT IMPULSES ARE APPLIED TO MISTUNED CIRCUIT 

We illustrate the use of the equations derived above by carrying 
through the evaluation of (62) when the message pulse source consists of 
independent on-or-off unit impulses and the ratio of tuning error to the 



STATISTICS OF REGENERATIVE DIGITAL TRANSMISSION 1523 

signaling rate is small compared with unity. We adopt the following 
notation : 

fe(&)o — w r )/aj r = fractional tuning error, 

a = u> T/±Q = (1 + k)r/2Q, 

(81) 

|8 = (1 + fc)T, 

co [(/. c - r/2) + a] - *. 

From (69), then, 

sin * = tanh a cot /3 (1 + tanh 2 a cot 2 /3) _1 "', 

cos * = (1 + tanh" a cot /3) ". 

Then, from (78), we may write, after noting that av x(t c ) = implies 
av x\t e ) = av y\t c ) : 

av x\t e ) = 

mi(l - miWW + 1) cxp[ -«„«„ - r/2)/Q] ,^2 9a (g3) 
16/2 2 Q 4 sinh 2a (cosh 2 2a - cos 2 2/3) 

+ sin 2 2/3 4- sinh 2 2a cos 2/3 cos 2<f> — sinh 2a cosh 2a sin 2/3 sin 2<J>}. 

From straightforward trigonometrical manipulations, 

. rt „ 2 tanh a cot /3 

sin ^*p = . 

1 4- tanh 2 a cot 2 /3 ' 

1 — tanh" a cot /3 

cos 2$ = - — — - — r^ -^-r • 

1 + tanh- a cot- /3 

When the values of sin 2* and cos 24> are substituted in (83) we find, 
after some reduction : 

av x\t e ) = 

mid - wiW(4Q 2 4- 1) sin 2/3_ (85) 

exp { -Q \d 4- arc tan (tanh a cot $))) 
WR-Q X sinh 2a (cosh 2 2a - cos 2 2/3) 

In the high-Q case, the value of av x(t c + T/4) will be very nearly equal 
to the maximum value of av x(t) as given by (68). Making this assump- 
tion and simplifying, Ave obtain: 

av 2 x(t c 4- r/4) = 

otiW(4Q 2 4- 1) exp { -Q~'U/4/ r + 4- arc tan (tanh a cot <S)]| (g6) 
16ft 2 Q 2 (cosh 2 a - cos 2 /3) 
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Then, from (62), 

2 ± (1 - ?»i) sin 2 2/3 exp (— Mo/4/rQ) 

4wii sinh 2a (cosh 2 a — sin 2 8) 

(87) 
= (1 - wi) sin 2 2/oir exp [-(1 + fc)ir/2Q] 

4mi sinh (1 + /c)x/Q [cosh 2 (1 + A:)t/2Q - sin 2 far] ' 
In the limit for k <5C 1 and Q » 1, which is the region of practical interest, 



av e — > (1 — m,i)irk~ Q/mi . 



(88) 



The rms phase error is the square root of this quantity. For equal proba- 
bility of pulses and spaces, mi = \, and 

€rn,s = (aV 6 2 )' /2 = k\^Q. (89) 

Fig. 9 shows a set of curves of rms phase error vs. Q for fixed values of 
tuning error. It is to be noted that this performance is attained when the 
reference phase of negative axis-crossings is t c defined by av x(t c ) = 0. 
This value of time is displaced from the time to defined by (42), which 
would be the correct reference if there were no mistuning. The difference 
is accounted for by the steady-state phase shift of the network at the 
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Fig. 9 — Phase error in timing wave from mistimed recovery circuit. 
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pul.se frequency. If we were to take the axis-crossing reference time as 
to , the mean square phase error would be determined by av .)•"(/„) instead 
of av x 2 (t e ) in (62). Since av x(Ut) does not vanish, the expression for 
av .r 2 (/ ) must be written as 

av x%) = av" x(t ) + av y%). (90) 

From (42), 

/o = r/4 - Td/2r, 

t - r/2 = - T/4 - 0/u, = - (0 + ir/2)/w r> 

cos [w (/o - r/2) + 0] = cos [(1 4- fc)x/2 - A-01 

= - sin [A-(tt/2 - 0)], 

(91) 
sin [o> (t - r/2) + 0] = cos [k(W2 - 6)}, 

cos2M<o - T/2) 4- 0] = - cos /v(tt - 26), 

sin 2M< - T/2) + 6] = - sin fc(ir - 20). 

Substituting these values and taking the limit for k « 1, and Q » 1, 
we find the rms phase error in the region of interest to be given approxi- 
mately by 

. fc(l + 1/40) 



(tf 4- 1/4Q 2 ) 1 ' 2 



= 2Q/c. (92) 



The dashed curves on Fig. 9 show the values of error thus obtained and 
indicate the importance of a phase adjustment to optimize for the tuned 
circuit in use. 

It remains to evaluate the variation in peak height of the tuned cir- 
cuit response. This requires evaluating av f" from (04), which in turn re- 
quires calculation of av if{t c + r/4) from (78). As in the case of av 2 
y(t c + T/4) it is sufficient to take the maximum value of (78) over a period 
in t. The evaluation of av f 2 is facilitated by immediate comparison of the 
resulting expression for av 2 y(t c -\- r/4) with that for av 2 x(t c + r/4) 
given by (86). We find 

n -(, i_ T/n o * ,t, _l T/n B ( l ~ wi)(cosh 8 a - cosh 2 /3) , , 

av y (/<■ + J /4) = av x(t e + 1 /4) ^-^ — t— - 5-— r , {y.i) 

mi smh 2 a (cosh 6 2a — cos 2 2/3) 

where 

B = cosh 2 2a — cos" 2/3 

+ sinh 2a[sinh 2 2a cos 2 20 + cosh 2 2a sin 2 2/3] 1/2 . 



(94) 
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Then, by some further manipulation, we find: 

av r = 

(1 - mQfsinh 2 2« + sin 2 2/3 + sinh 2a(sinh 2 2a + sin 2 2ff) L/2 ] (° 5 ) 
4w?i sinh 2a (cosh 2 a — sin 2 /3) 

In the limit when Q ^> 1 and A* <3C 1, we obtain 



a f 2 = ^ " m *)*Q 



L-i_4P4-i.fi 

4mi(l - fcV) LQ 2 Q \Q 2 



«■)••]. 



With no tuning error, the ratio 



avT 



(1 — /»i)tt 
2miQ 



(06) 



(97) 



can also be obtained by taking the ratio of (80) to the square of (71). 
When k « \Q, the limiting form is 



.2 . (1 — TUlJir lx , j2/^2\ 



(98) 



If /; is fixed and not equal to zero, the limit as Q is made very large is 

(1 — mi)irQk 2 



avr = 



M?-l 



(99) 



The analysis given here is valid only when a v £ 2 « 1 . 

V. EFFECT OF NOISE ON TIMING 

The question of timing errors caused by noise superimposed on the 
received pulse train can be resolved into two parts: (1) the shift in refer- 
ence time at the input to the tuned circuit and (2) the resultant variation 




Fig. 10 — (ieometriciil construction showing relation between noise and Lim 
ing error. 
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in the phase of the tuned circuit response. The first question can be con- 
veniently answered by a geometrical argument based on Fig. 10. Here 
an enlarged section of the message pulse wave front is approximated by 
a straight line ab of slope equal to that of the pulse at the unperturbed 
critical time /,, . The instantaneous noise voltage v n advances the critical 
time by 6„ , where o a /S„ = slope, and hence 

5„ = v„/g'(t ). (100) 

Statistics of 5„ can be evaluated from the statistics of the noise and the 
specification of the pulse waveform. In particular, if the instantaneous 
noise values at corresponding instants of signaling intervals n intervals 
apart are not independent but have an autocorrelation or autocovariance 
function R v (n), the resulting time shifts have the corresponding function 
Rt(ri), where 

R,(n) = av (M*+„) = av (tw*+„Wfa>). (101) 

The average is taken over all time for one member of the ensemble to 
give the autocorrelation or over the ensemble at fixed time to give the 
autocovariance. We assume here that the process is ergodic and hence 
that the two averages are equal. We have also assumed that the slope 
of the signal pulse is constant in the neighborhood of the slicing level. 

In the second part of the problem, we assume perfect tuning of the re- 
covery circuit and write for its response 

z(l) = Z a n9o (t - nT + U (102) 

71 =—00 

Here g^{t) represents any response function which reproduces the axis 
crossings correctly and, in particular cases evaluated, it will be assumed 
as the impulse response of a tuned circuit. We assume that the individual 
values of 5„ are sufficiently small to enable an accurate representation by 
first-order terms in a power series, thus: 

z{t) = Z a n [g (l - nT) + 8 n go'(t - nT)] 

n - x m (103) 

= x(t) + E a^goV - nT). 

n=— » 

Without loss of generality, we may take av 5„ = 0, since a constant time 
shift may be compensated by a change in the reference time. Then, if the 
noise and message ensembles are independent, 

av z(() = av.r(0. (104) 
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We next calculate the autocovariance of the perturbed tuned circuit 
response as 

av [z(t)z(t + r)] = av [x(t)x(t + r)] 

- - (105) 

+ 2_) ^_) av (a m a n ) av (5 m 8 n )gu'(t — mT)g '(t — nT + r). 

The first term on the right represents the unperturbed autocovariance 
and has already been evaluated. The effect of the noise is given by the 
second term and, by use of the same technique as in obtaining (16), we 
obtain its autocovariance as 

R:-:(t, t) = 

» » (106) 

E E R(m - n)R s (m - n)g '(t - mT)g '(t - nT + r). 

m=— oo n=— oo 

Iii particular for the case of independent message values, 

tf.-_,(r, = my E Rs(m)go'(t - mT)go'(t - mT + r), (107) 

and 

av [z\t) - At)] = /?,_,(0, t) = mi E Rt(m)W(t ~ mT)]*. (108) 

We may treat the phase error caused by noise in the same way as we 
did the mistiming error in deriving (62). Since, with no tuning error, 
av x\t„) = and t c = T/± - 6/2vf r , 

.,„ - av 2 2 (4) / ino x 

ttV € " = * /, ■ rn/t\ • ' 10J J 

av 2 x(t c + T/4) 
If the input noise values are assumed independent, 

Rt(m) = av 8,; = av v,'/[g'(l,)f = d\ (110) 



Then 



If 



av z\t c ) = n h 8- E [<7oU - mT)] 2 . (Ill) 



g (t) = A<T at cos(co r / + 6), (112) 

it follows that 

g '(t) = Be~ al cos(o. r / + d - $), (113) 
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where 

B = (a + ta?) m A, tan* = w r /a. (114) 

Hence, the previous evaluation of (79) can be used for av z 2 (t c ), replacing 
by 6 — $ and multiplying the result by (a + u) r 2 )5 2 . Then 

2 . . »t,_ r V(4Q 2 + l)exp(fl + *)/2Q , , . -v 

The limit as Q approaches infinity is 

The expression for av e„' J is found from division by the square of the 
amplitude factor of (70), giving 

av e,; = mr' co/V exp [(3* - 20)/4Q] tanh (tt/2Q) 

Ul7) 
-555* aS Q ^°° 

The effect of noise on the recovered timing is seen to vary inversely with 
Q and hence may be made arbitrarily small by using a sufficiently high-Q 
circuit. The effect is opposite to that of tuning error which becomes worse 
as Q is increased. The possibility of an optimum Q taking both effects 
into account thus exists. 

VI. EFFECT OF TIMING VARIATIONS ON A DECODED ANALOG SIGNAL 

The effects of timing errors are of two main kinds. First, they increase 
the difficulty of reading the message correctly because the decisions are 
made at a less favorable point on the pulse wave. This is called the align- 
ment error and is particularly important in a long chain of regenerative re- 
peaters. It has been discussed by E. D. Sunde 4 and is also analyzed in the 
companion paper by H. E. Rowe. 1 It will not be treated here. The second 
effect is to impair the usefulness of the received digital message even 
though the correct sequence of values is delivered. The seriousness of 
this effect varies widely with the type of message. At one extreme, the 
recovery of printed text from a telegraph message would hardly be 
affected. An analog signal transmitted by pulse code modulation, on the 
other hand, is in some danger because the decoded signal is not correctly 
reproduced by irregularly spaced samples. A single-channel system would 
undergo phase modulation from this cause. In the case of a time-division 
multiplex system, some interchannel crosstalk may result if the jitter 
varies with the signals in the channels. The most severe requirement or- 
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curs when PCM is applied to transmit a group of frequency-multiplexed 
channels, since any waveform distortion can mean interchannel crosstalk 
after the channels are separated. 

We should point out at the beginning that we are not forced to accept 
time jitter in the received digital wave as finally used. A master clock 
could he inserted at any stage to force the pulse back into a proper tune- 
reference framework. By means of resampling combined with pulse 
stretching and delay line distribution techniques, such corrections can 
be made even when the extent of the tuning variations exceeds the signal- 
ing interval. It would, of course, be desirable to avoid these operations 
and hence it is important to determine the permissible extent of time 
jitter in specific situations. We shall consider here the case of multiplex 
speech channels in frequency division transmitted by pulse code modula- 
tion, the FDM-PCM system. 

Our procedure will be to represent the multiplex signal by an ensemble 
of band-limited functions \s(t)} having a spectral density w„(f) which 
vanishes for J / 1 ^ /n . Any member of the ensemble is completely de- 
fined by its samples taken l/2/ apart; in fact, by the sampling theorem, 
we have the identity: 

«(o- i S («/2/„) si " 2 :jf l + sag . (us) 

The right-hand member is the response of an ideal low-pass filter to im- 
pulses of weight proportional to the samples. The effect of time jitter is to 
introduce an irregular spacing of the recovered samples which, when 
applied to an ideal filter, produce the distorted wave 

.«= ± 5 (»/2/,) si f^ ( ' + \ + j/n 0) - < 119) 

«=-oo 2irf {t + M« + tt/2/o) 

The timing errors are represented by u n = u(n/2f ), where {u(t)\ repre- 
sents a jitter ensemble with specified statistical properties. 

The evaluation of interchannel crosstalk is conveniently accomplished 
by assuming signals present in all but one of the FDM channels. The 
spectral density «>„(/) is set equal to zero throughout the frequencies occu- 
pied by the idle channel. Values in this free juency range of w a (f), the spec- 
tral density of the recovered signals, then give the interchannel inter- 
ference caused by the time jitter. This method has the advantage of 
separating the interchannel interference sought from in-band distortion 
which is of no consequence. We refer to a previous paper 6 for a descrip- 
tion of some of the necessary mathematical techniques. 
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We assume that s(/) and //(/) have autocovariance functions expressed 
in terms of the spectral densities by: 

ft.(r) = f " wXf) exp U'ItttJ) <IJ\ (120) 

Ru(t) = [ " «»„(/) exp (j27tt/) <lf. (121) 

It is no loss of generality to assume that u(t) is band-limited to the range 
— /u to/o , since higher frequency components would produce effects in- 
distinguishable from those in the band of half the sampling rate. The 
spectral densities are in turn expressible in terms of the autocovariances 
by 

wAf) = [ B.(T)exp(-y2r/T)dr, (122) 

J— CO 

<■(/)=[ R,(r)exp(-j2wfr)dr. (123) 



w 



The s- and u- ensembles are assumed to be independent and ergodic. 
Note also that the signal density spectrum is defined in terms of mean 
squared voltage or current values, while the jitter spectrum is expressed 
in terms of mean square values of time. 

Our procedure is to calculate first the autocorrelation function of the 
a(t)- ensemble by the definition 

00 CO 

R„(t) = av a(t)a{t + t) = av E Z s(m/2/o)*(n/2/o) 

(124) 
_ sin 27r/u(l + u m + m/2/ ) sin 2irf (t + r + u n + n/2f ) 

4ir% 2 (t + Un, + m/2f )(t + r + Un + n/2/o) 

The spectral density of the distorted signal ensemble is then given by 



u\ 



,(f) - f R a (r)exp(-j2TfT)dT. (125) 

J— CO 



We assume ensemble and time averages to be interchangeable by the 
ergodic assumption. The averaging over the s- and u- ensembles may be 
done separately because of their independence. Furthermore, the double 
series may be averaged term by term since, in any case, the average of the 
sum is equal to the sum of the individual averages. We first note that, for 
the s- ensemble averaging, 

av [s(m/2/ )s(n/2/o)] = av [s(m/2f u )s(m + n - m)/2/ ] 

(126) 
= /?„[(» - m)/2/ ] = R.[(m - n)/2f ]. 

The averaging oA'er the i<- ensemble is more troublesome. 
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It has been found possible to obtain a reasonably simple answer only 
in the case of a gaussian jitter ensemble. By an involved calculation, 
which is explained in the Appendix, we obtain for this case, setting 
T = l/2/o, 

K„( T ) =!» f R.(nT ) (" '" exp {-iU*) cos (r - nT )z ch, (127) 

IT «=-oo JO 

where 

t/„ 2 = R„(0) - Rn(nT ). (128) 

In terms of the complex error function, 

RM = * ± ^ He erf (j£ - i t±^) . (129) 

In the case of PCM transmission of an FDM group, the allowable 
jitter is small. This means that the integral of the spectral density «>„(/) 
must be small and, hence, that R„(0), which is equal to this integral, 
must be small; R«(t) assumes its largest values at r = and we con- 
clude a fortiori that Un must be small. Hence, we approximate by re- 
placing exp ( — z 2 Un) by zero and first-power terms in its power 
series expansion and obtain an approximate value of the integral in 
(127): 

Ro(t) = 2- /?.(«/«) - a ' t „ r ■> (/ ~ 47r -'° f " ' 

„ — oo 2it/o(t + nlo) 

r . 2 [ cos 27t/ q (t + -mTq) _ r sin 2tt/o(t + wT ) ~| 
" L (r+ "To) 2 tt(t + kT ) J 

By a further manipulation also given in the Appendix, we find that this 
approximation yields for the spectral density 

w„{f) - (1 -4tt 2 /VK(/) (igi) 

+ 4tt 2 /Wu(/) + ww(2/o + /) + to.-(2/o - /)]; I / I < /" , 
where 

Mo = V/?v(0) is the rms time jitter and (132) 

«>.*(/) = [ w.(\ + f)w u (\) d\ 

J— co \l QO ) 

= convolution of signal and jitter spectrum. 

We note that the first term consists of the original power spectrum of 
the signal depressed by the "crowding" effect factor (2t/mo) ■ The crowd - 



(130) 
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ing effect docs not introduce new frequencies not present in the original 
signal and therefore does not contribute to interchannel interference. The 
interference is given entirely by the second term, which consists of dif- 
ferentiated convolution spectra of signal and jitter. The differentiation 
is expressed by the multiplying factor {2irff, which gives a triangular 
voltage spectrum like that of thermal noise in frequency modulation. 
The term w a . u (j) represents the direct convolution of signal and jitter 
spectra, while «w(2/o ± /) represents sidebands of the convolution spec- 
trum on the sampling frequency. 

In testing of multichannel systems by noise-band loading, as pre- 
viously mentioned, the signal spectrum applied is flat except for the nar- 
row band assigned to the channel under test. The power spectrum is 
made equal to zero throughout the test-channel frequencies (see Figs. 1 1 
and 12). The expression for w„(f) is then: 



Ws(f) = 



K; |/| <f t 



and 



fl+fc < |/| </o 



(134) 



|0; /, < |/| </, +/,. , 



where f, is the test channel carrier frequency and f c is the bandwidth of 
one channel. (We have assumed a single sideband system with upper 
sideband transmitted.) Then (133) gives 

i—fi-f e eft rfo 



wUf) = K 



wM + \)d\. (135) 



_J_ /o J_ /( Jft+fc- 

It is sufficient to evaluate the interference spectrum in the test channel 
range f t to ft + /„ and — /, —f e to —J, . Since power spectra are even 



wjf) 




"(3fo-f 



Fig. 11 — Spectral relations for noise band as test signal with/, > f /2. 
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w«CfK 



-w„(f) 




-Ofo-f) 



-(zfo-f) 



Fig. 12 — Spectral relations for noise band as test signal with f t < fo/2. 

functions, we actually need to calculate for only one of these intervals. 
There are two contributions from (131) to the positive interval — one 
for uw(/) and the other from w,.„(2/ - /). The term uw(2/ + /) 
vanishes for/ > since w a * u (v) is zero for v > 2/ . 

The contribution from uw(2/ - /) to the positive interval ft toft + Ze- 
is defined by the interval 2/,, - / - ft + fc to 2/ - ./' = ft or / = 2/ - 
f t — f c to / = 2/ — ft . We must therefore evaluate w a * u (f) in the 
ranges /, toft + U and 2/ - ft - fc to 2/ - ft . 

Figs. 11 and 12 show the limits of integration which apply for the 
cases of /i greater than and less than/o/2, respectively. From these dia- 
grams, we deduce that the distortion spectrum in the range f t < f < 
ft + fc , is given by 

Wad ( f) = ±TT 2 r-K if' ' [w„(f + X) + u>„(2/„ - / + X)] d\ 

J- fa 



J -fa 

•/o-/( 



/la— 1 1 
w u {f + X) d\ 



:i36) 



J-f 

• f-fo 



+ £ ° w u (2/o - / + X) dX 



for/>f, 



and 

Wad(/) = 4vfK 



ur*c*i 



J-/Q 

-f-fo 



p/o-/"| 

J ft+fo_ 



w„U + x)dx 



+ j w„(2/o - / + X) f/\| for/<^. 



(137) 
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A special case of interest is that of a flat jitter band over a low-fre- 
quency portion of the signal band. Rowe's previously cited work 1 on 
regenerative repeater chains indicates that the jitter spectrum peaks at 
the low-frequency edge of the signal band as the number of repeaters 
becomes large. Suppose the jitter spectrum is uniform from — F to F, 
f < /„ and consider the case of /, > / /2 and F < /„ - /, . This corre- 
sponds to a test channel in the upper half of the signal band but below 
the top by at least the width of the jitter band. The distortion spectrum 
is given by 

m ±rf 2 Ku 2 / r f >-'< . r' +F \ Jx 

uUf) = - J w-\L f . F + 1,, ) dx 

- ^ fKvi (-/, - /,- + / + F - f + F + /,) (138) 



2F 



= m^ 2 {2F - >•> 

= IwfKuo iif e «2F* 

The mean square total interference voltage in the idle channel is 

f/l+fc 

Uo = 2 / w ad (f) df = STf t 2 Kuo 2 f e . (139) 

If the moan square signal is s \ we have 

si = 2Kf , (140) 

and 

% = 47r 2 / t V/c//o. (141) 

So 

The dependence on the square of test-channel frequency shows that we 
have a triangular voltage spectrum like that obtained in FM. 

A quantity of interest defining signal quality in the typical channel of 
the frequency-division multiplex system is the ratio M of mean square 
value of the sine wave test tone which fully loads the channel to the mean 
square interference voltage when the channel is idle and the other chan- 
nels are being operated in a normal manner. The mean square full load 
test tone voltage on one channel of an FDM telephone system is related 



* The implications of this approximation should not be overlooked. If the band- 
width of the jitter spectrum is small compared to a channel width, interchannel 
interference would result only from high-order modulation neglected in the 
aliove approximation. 
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to the mean square full load test tone for the entire .system by the Hol- 
brook-Dixon 7 curves, which we shall express in the form 

Mn = nPi/Pn, (142) 

where 

Pi = full load test tone mean square value necessary to transmit one 

voice channel, 
P n = full load test tone mean square value necessary to transmit n 

superimposed voice channels. 

When the multiplex system is operating normally the active channels 
are loaded with voice signals and not by sine waves. The value of s ", 
the mean square total signal voltage with speech loading, may be ex- 
pressed as 

so 2 = PJH\ (143) 

where H is the ratio of the peak factor of a sine wave to that of a compos- 
ite multichannel speech wave. This is based on the assumption that the 
normal speech loading reaches system overload occasionally. The peak 
factor of a sine wave is \/2, corresponding to 3 db, while the peak factor 
of superimposed speech channels approaches that of thermal noise as the 
number of channels is made large. The peak factor of thermal noise de- 
pends on the value of the probability of excess chosen. A value often 
used is 4, corresponding to 12 db, for which the probability of observing 
greater peaks is one in 10,000. This choice fixes H 2 at eight, corresponding 
to 9 db. 

We write, in accordance with the above, 

M = Pifuo, (144) 

and assume M specified. It follows that 

M= M " P ' f ° = "•*•*. (145) 

4x 2 fcUo-nfcSo 2 4t 2 fcuohifc 

Solving for uo, we obtain the minimum requirement for mean square 
time jitter: 



Mo = 



H'f M n 

±ir-ft 2 fcnM ' 



(146) 



Because of the triangular distortion voltage spectrum, the requirement 
is most severe at the highest channel carrier frequency. 

It is convenient to express this requirement in terms of rms phase 
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jitter $ allowed at the digital pulse frequency, which is 2Nf for an iV-digit 
PCM system. Since 4> = 27r(2A// )uo , 

^ = ±w^, (147) 

nft 2 f c M 

Consider, for example, an 8-digit binary PCM system transmitting a 
2000-channel single-sideband FDM telephone signal with 4-kc carrier 
spacing. The top channel is at 8 mc and imposes the most severe require- 
ment. We ask for a 60-db ratio of full load test tone power to idle channel 
interference. Assume the sampling frequency is 20 mc. We evaluate M n 
by extrapolating from Table I of Ref. 8: H 2 = 8, .V = 8, /„ = 10 7 , 
M„ = 2000/80, n = 2000,/, = 8 X 10 6 , f c = 4 X I0 :i , M = 10 6 , and 
we calculate <p = 0.3 radian. This result is close to estimates made by 
O. E. DeLange and E. D. Sunde by different methods. 
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APPENDIX 

By the definition of a time average, 



RM = lim wl ivr ^ ^ RA(m - n)T ] 

,%'=» {4l\ "T l)l0m=—N n=—N 
J- NT 



!ro mi ^ (t + mT + «„,) sin ^ (t + r + nT + u n ) dt ( 148 ^ 
Jo i o 







(t + mT + u,„)(t + T + nT + u n ) 



The integrand is an analytic function of / in the finite plane and hence 
the path of integration may be deformed without changing the value of 
the integral. We replace the part of the path passing through the zeros 
of the denominator by downward indentations. Sum and difference 
formulas may then be applied to the sines to resolve the integral into the 
sum of separate components without introducing singularities in the inte- 
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grands. Designating the resulting path of integration by C, we then have: 
BM = lim t t ? M{m - n)U 



N=oo m=— oo n=— oo 4/V 7T" 

dt 



L 



(t + wiT + u m )(t + r + n^o + m„) 

cos 7H- [t + (n — m)To + i<„ — w,„] 
Jo 



- cos ^ [2£ + t + (m + n)T + w,„ + u„] > . 
J o 

To evaluate the integral, write: 

mTo + u m = a\ 

t + nT + m„ = bf 

Note that a and b are real numbers. We must calculate: 



(149) 



(150) 



L 



cos 21 (6 - a) f cos 21 (2* + a + 6) 



a (t + a)(< + b) Jc it + a)(< + 6) 

The first integral vanishes as we let JV approach infinity, as may be seen 
by closing the contour in an infinite semicircle below the real /-axis. The 
absolute value of the integral around the semicircle of radius r cannot 
exceed the product of length of path irr and the maximum absolute value 
of the integrand, which is less than 1/r 2 . The integral around the semi- 
circle is therefore less in absolute value than x/r and approaches zero as 
r goes to infinity. The integral around the closed contour including C 
and the semicircle must vanish because there are no singularities inside. 
Hence the integral over C also vanishes and the first integral is zero. 
The second integral may be written as the sum of two terms: 

e ' V(a+6)/r ° f e j2vtlTo dt , <T jV(a+ " )/ro f e- i2Tt!To dt (151) 

~~ 2 Jo (t + a)(t + d) 2 Jc (t + a)(t + 6) ' 

In the first term we close the contour in an infinite semicircle above the 
real i-axis and obtain an integrand which vanishes exponentially as the 
radius is made large. In the limit the integral along C is then equal to the 
integral around the closed contour, which in turn is equal to 2r/j times 
the sum of the residues at the poles t = — a and t = — b. In the second 
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term we close the contour below the real /-axis and show that the integral 
vanishes. Therefore the complete result is given by: 



'2irj jr(a+l,)IT ( ( 



\b - a a - b) 



T J lJ*(a-b)T -j*(a-b)IT 



[e" ,fl - wr ' - e -"<-"' r <»] (152) 



a - b 

_ 2tt sin 7r(a - b)/T 

a — b 

Hence, 
BM = 

,v at r /^[(w-n)7'o]sin^[(m-n)T„+« m -w n -T] ( 153 > 

lim X) Z) OAr ,, ^n i • 

jv =00 „ — .v 6 — a- 2J\w[{m — n)lo -f- «,„ — u n — t] 

For purposes of calculation it is convenient to introduce the dummy 
variable z and write the equivalent form: 

/•ir/To 

R.(t) = / dz 

Jo 

•y y» ToR„[(m — n)T ] co s [(m — n)T + u,„ — u„ — t]z 



>i=—N n=-N 



2Ni 



Next we change the order of summation by letting m — n = m! and 
dropping the prime after eliminating m to obtain 

/•t/5'o 

RM = \ dz 
Jo 

(155) 
J2 Y TMwTo} cos (,nTo + M "'+" ~ n " ~ r) ~ 

n— A/ ;«= — A'- 7i 2A^7T 

The summation can be rearranged into the equivalent form 

I) -V 2.V N—m 

m—2N n< If— m m— ] »=-AT 

so that the summation may be performed with respect to n first. For 
each value of ra there are 2;V + 1 values of n. When N is large, summing 
over the values of the function 

G(nTo) = ™ mTo) cos \mT + u[(m + n)T ] - u(nT ) - r}z (156) 

7T 
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for 2iV + 1 values of n with m fixed and then dividing by 2N approaches 
the procedure for calculating the average of G(nT) over the u-ensemble. 
To evaluate the ensemble average of G{nT ), we invoke a theorem ex- 
pressed by equation (1.14) of Ref. 0, which states that, if u(t) is a gauss- 
ian ensemble, 

av {cos [au(t) + bu(t + r) + /3]} 



[a + 



= rxj)| _tA"ff«(0) -a6i?„(r) 



a (157) 
cos p. 



We shall assume from this point on that u(t) is a gaussian ensemble. 
Then the above result fits our case if we set t = nTo , a = —z,b = z, 
= (mTo - t)z, t = mTo . We then find 

av G(nTo ) = TMmTo) ^fc^wi cog (wn _ r)2) (15g) 

7T 

and 

rlT (159) 

f' r ° - zHRuW -n u ( m nn cog [(t _ mTo)2] dz 
Jo 

The integral is now evaluated by writing the cosine in exponential 
form, completing the square in the exponent, and substituting variables 
to obtain the error function. The result is given as (129) of Section VI. 
We have replaced m by —n and made use of the fact that the autocorre- 
lation function is even. 

We next calculate the power spectrum w a (f) by taking the Fourier 
transform of the approximate autocorrelation (130). The complete in- 
tegrand has no singularities in t and, by indenting the path of integra- 
tion below each point t = — nT , we can separate the integral into com- 
ponent parts without singularities on the path. Denoting the depressed 
path by C, we evaluate 



/. 



e sin -=- (r + 
J 

,t(t + nT ) 


nTo) 

dr 




= f [r"""- c * 

Jc 


T )]T+jmr 


-i[2ir/+(i/r n )]T-jinr| dr 


J 2ttj(t + nT ) 




0; 1/ 


1 

> 2T 

i 






ftnir/To. 1 f 


< 27 r 





(160) 
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e-** fT cos £ (r + nT ) 

Jo 



(r + nT Q y 

■ [ \ „-)&*/-(* I t )}t+}"* i -if2T/+(T/r )]T-ynxi dr 

ic J 2(r+n7'o) 2 (16) 



0; 



">2T n 






/■If ff I J-"'fTo. I /• I - 1 



e sin — (r ■+- ?i7 ) 

£_o 

(t + nTo) 3 



dr 



r -J[2ir/-(ir/r u )jr+j'nir _ -/[2ir/+(ir/ro)]T-JBXi 



di 



2j(r + nr„) ; ' (102) 



0; 



/l> 5 



7; 



-2^-Tl, 



finrfTa 



' ' * ' < 2T 



(163) 



Then, for | / 1 < 1/2T ; that is, | / | < / : 

w a (f) = E w TMnTo) [l " ^ U* - 2U n V (2/ - ~) 

= 7'o E fi,(nr )(l - 4,r 2 / 2 tf 7l V n ' /r . 

n=— 00 

From (120), we note that w s (£) vanishes outside the range — / to/o , 
/2.(nT ) = ( Ws(v)e i2 ' nTo ' dv, (164) 

*"— CO 

and from the analogous relation for R„(t), 

R,,tnT ) = f w u {v)e j2 '" uv dv. (165) 



(167) 
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Application of the convolution theorem shows that 

R a (nT )R u (nT ) = f" w^W*™* " du, (16(i) 

where 

w s * u (u) = ] w s (X)wu(A + v) d\ 

= f w£\ + v)w„{\) d\. 

We substitute the above expressions for R s (nT {) ) and R s (?iT a )R u (nTo) 
in (163) and then apply Poisson's summation formula, 

E f <p(z)c'" : dz = 2w Z <p(2iit), (168) 

to obtain, for | / | < /o , 

w a (f) = [i - ** 2 fRu(0)) Z v>,(£--f) 

"— V ° ' (169) 

+ 4,7" ± w a .J^--f). 

Since both «j,(/) and w u (f) have been assumed to vanish for | / | > /o = 
1/2 To , the only term of the first sum which falls in the signal band — . f to 
f is that for n = 0, while in the second sum the signal-band contributors 
are n = 0, — 1 and 1 . The latter conclusion follows from the fact that the 
convolution of two functions limited to the same low-pass band is limited 
to a low-pass band twice as great. Also, noting that power spectra are 
even functions, we obtain CI 31). 
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